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Typically, when you’re being 
reviewed, it’s difficult to see 




THE EMAIL WAS ADDRESSED NOT ONLY TO ME, BUT ALSO TO 
all the Project Knowledge Sharing Community at Ames 
Research Center. We were invited to sit in on a major 
project review as a new experiment in knowledge 
sharing. This first-of- its- kind opportunity had been 
conceived by Claire Smith, who leads the knowledge 
sharing program, as well as heading up the Center’s 
Project I .eadership Development Program and serving 
as coordinator of the APPL-West program at Ames. 

The objective was to offer Ames project practi- 
tioners the opportunity to observe project-review 
processes as they happen. Not that 1 haven't participated 
in my share of project reviews, but this seemed like a 
great way for me to get up-to-date about a new project, 
the Kepler mission, and to experience a review from a 
new perspective. 

Typically, when you’re being reviewed, it's difficult 
to see what's happening objectively — the same way it is 
on a project. Presenters are always thinking, “Okay, 
what’s on my slides? How much time do 1 have left? 
What are they going to ask me?" So when Claire's email 
pinged on my computer, I quickly responded bv asking 
her to save a place for me. 

It was to be an informational review about progress 
on the project: what the team had done, where thev were 
going, and what they needed to do to get there. There 


were people on the project team from all over the United 
States, and it was the first time for them to get together 
from all aspects of the project. 

For our part, as observers, we were asked to abide by 
a couple of rules: Don’t ask any questions, and don’t talk 
about the specifics of what we saw or heard. The idea 
was that we weren't supposed to be noticed. We weren't 
to buzz around and bother people Hence the name for 
this experiment: Fly on the Wall. 

I got there early because 1 wanted to find a seat 
without disturbing anyone. By the time the review got 
underway, there were probably about fifty people in the 
room. The main members of the review board were at a 
large table. Subject Matter Experts on the project were 
seated in three rows on one side of the table. Many of 
the people in the room never spoke. Some of them could 
have been observers like me, but 1 don't know that. 1 may 
have been the only one to observe, although 1 hope not. 
It was a remarkable experience. 

Project Manager Chet Sasaki from JPL kicked off 
the review by introducing the Deputy Project Manager, 
I .arty Webster from Ames, and the Principle Investigator, 
William Borucki, also from Ames. 1 was impressed right 
away that the meeting started on time, and then stayed 
on time, even finishing a little ahead of schedule for the 
morning session that 1 attended — this in spite of a lot of 
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discussion of the management strategies and who has four hours I was there and how smoothly it went. He 
what responsibility. said, "Yes, but you didn't see the pre-runs that we did 

One thing that they did that I thought was unique before we came into the room, and the things we cut out 

was that one person at the table was appointed to be an that we felt we could do away with." So, they had done 

ombudsman. His job was to cut off discussion when it an excellent job in their preparation to make sure that 

was more appropriate to take a conversation off-line. In everything fit in the time available, 

the past, I had seen people take on a role like that at The only thing I found that didn’t work well was a 

reviews out of frustration, but in this case it was a desig- minor set-up detail. They had used pushpins to hang 

nated role. This person cut off discussion several times huge sheets of paper with diagrams and information on 

during the meeting. This was the walls. With the seats arranged 

done in a polite, professional _ as they were along the wall, people 

manner, often at the request of I W 3 S impressed pushed their chairs back into these 

one of the participants in the charts and they started to fall 

discussion, and it worked quite fight 3W3y tll3t the down. It got to be a little annoying 

well. Everyone deferred to that because it was noisy and it 


person's judgment when it was 
time to move on, and that was 
an important reason the 
meeting kept on schedule. 

The review was structured 
well, too. No fewer than eight 
separate functional organiza- 
tions across the U.S. who have 


meeting started on 
time, and then 
stayed on time. 


disturbed the people presenting, 
although they did their best to 
ignore the distraction. A couple of 
us grabbed a handful of additional 
pins and fastened down the sheets 
when we saw this was going to 
continue to be a problem. 

I was under one particularly 


integral roles in the project attended the meeting defiant chart that kept falling on me. Except for that, being 


including Mission Operations, the Science Office, Mission a fly on the wall was a safe experience. Seriously, it 


Management, Flight Planning Center, Flight Control provided an interesting perspective of the presentations 


Center, Science Processing Center, Data Management going on and the interactions in the room. 1 believe Claire 


Center, and the Deep Space Mission System. 
Representatives from participating international organiza- 
tions also attended. 

One person ran the presentations, handling the 
transition from one presenter to the next, and actually 
taking part in the presentations. Most of the reviews that 
I’ve been involved in have been just a constant series of 
slides, somebody talking for awhile and then moving on 
to the next person, and so on, and so on. The Kepler 
review was much more interactive. They stopped after 
every presentation and said, “Okay, time for questions.” 
Each time a question was asked, it was decided immedi- 
ately whether the question was appropriate for the entire 
group and, on several occasions, a question was deferred 
to be taken up later by a relevant group. In addition, the 
ombudsman had to announce a couple times, “Okay, it’s 
time to move on.” 

I've been in a lot of meetings where discussions 
have spiraled out of control and, before you know it, 
you’re way behind schedule. These folks had their 
agenda down precisely. 1 told the facilitator afterwards 
how impressed I was at what they'd accomplished in the 
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has hit on a simple but extremely valuable knowledge- 
sharing technique that can be easily duplicated 
with other projects at other centers. 

As a matter of fact, I think it should be 
required that senior managers make their 
younger managers observe a review like this 
before they find themselves on the hot seat. By 
simply listening, there's so much to learn from 
what's going on. In addition, capturing some 
of the tips from observers and sharing them 
with project managers and teams across 
the agency might be another high- 
potential outcome of a Fly on the Wall. 

My hat is off to the Kepler 
Mission team for their thoroughness, 
professionalism, and focus, but also 
for their cooperation in this helpful 
and important experiment. • 




Some useful practices that I picked up from being an observer: 

□ Not introducing eveiyone in the room at the beginning of a meeting, but sticking to the 
key players at the table. Participants who gave parts of the presentation introduced 
themselves at that point, and others gave brief introductions when they contributed to 
the discussion related to their specialty. Some of these people were high-level 
representatives from other government agencies and participating companies who didn’t 
seem to mind not being introduced initially. 

□ Clearly stating the purpose of the meeting at the beginning, and even more importantly, 
clearly stating what the meeting “was not." This set the stage for the efficiency of the 
meeting, and I am sure reduced the number of distracting comments that often come up 
in these types of meetings. 

□ Assigning someone at the table (strong enough to do it) as an ombudsman to cut off 
discussion when it would be part of a later presentation (not relevant now), wasn't 
contributing much (those who love their own voice), or was more appropriate for off-line 
conversations (people who just can't let go, but might have something important to say). 

□ Posting a roles-and-responsibilities matrix with the key organizations across the top as 
column headings, and functional elements in rows down the left-hand column. The 
intersecting row-column blocks in the matrix clearly stated which organizations were 
responsible for what in each of the functions. 


DR. GERALD MULENBURG is the Manager of the Aeronautics and Spaceflight 
Hardware Development Division at the NASA Ames Research Center. He has 
project management experience in airborne, spaceflight, and ground research 
projects with the Air Force, industry, and NASA. He is a member of the ASK 
review board, and can be reached at gmulenburg@mail.arc.nasa.gov. 

Mulenburg observed a review for the ground segment of the Kepler Mission, a special-purpose 
mission in the NASA Discovery' Program with a planned launch in 2007. According to Principal 
Investigator William Borucki, the mission seeks to discover the presence of terrestrial-like 
planetary' systems around other stars to "answer one of the most enduring questions humans 
have asked throughout history': are there other planets like our Earth in the universe?’’ For more 
information about the mission, visit www.kepler.arc.nasa.gov. 
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